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ABS*^RAC^ 



The purpose of this study vas to compare the 
effectiveness of four training procedures in changing translation 
behaviors of intern teachers and their pupils in secondary school 
social studies classes. The four training procedures or treatments 
(applied to four randomly assigned groups of intern teachers) were: 
an unstructured discussion of material that was to be taught later in 
social studies class; (2) oral instruction on how to teach the 
material; (3) videotaped demonstration of how to teach the material; 
and (4) a combination of the oral instruction and demonstration 
procedures. "Translation” was defined as "statements about the 
meanings of written words and combinations of written words in light 
of the context in which the words were used" and was classified and 
measured according to (1) pupil translation statements (oral and 
written) and (2) seven types of teacher behavior ("translation 
strategies") . Analysis of tapes of classroom presentations and 
discussions indicated significant differences (.01 level) between the 
four treatments: i.e., the unstructured discussion procedure was the 
least effective; and the demonstration plus presentation procedure 
was most effective (.05 level of significance). Ho differences were 
indicated between treatments on the written test scores. (Author/ES) 
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* * 

The purpose of the study was to determine whether different train- 
ing procedures could change specific behaviors of Intern teachers and 
their pupils In secondary school social studies classes. Four training 
procedures were con^ared In the study: (1) an unstructured discussion 

of material that was to be taught later In a social studies class; 

(2) oral Instruction on how to teach the material; (3) a videotaped 
demonstration of how to teach the material; and (4) a combination of 
the oral Instruction and demonstration procedures. 

The Instruction and demonstration training procedures eflq>haslzed 
the development of ''translation'* of a given piece of material throu^ 
class discussion. Translation was defined as statements about the mean- 
ings of written words and combinations of written words In' light of the 
context In which the words were used. Pupil translation statements, 
both written and e:^ressed In discussion, were measured. Seven types 
of teacher behavior were measured: translation directions, elicita- 

tions, acceptances, rejections, probes, restatements, and periods of 
silence. 

The experiment was conducted In the regular program of teacher 
training In secondary school social studies In the Stanford Secondary 
Teacher Education Program. Forty-three social studies Intern teachers 
were randomly assigned to the four training groups. Within Ixo days 
after training all of the Intern teachers taught the same material In 
one of their secondary social studies classes. These discussions were 
tape-recorded and written translation tests were administered after the 



discussions 



Blind ratings of the tapes and tests averaged over 80 per cent 
agreement between two raters. The results Indicated significant dif- 
ferences (.01 level) between treatments on the translation behaviors 
of the teachers and pupils In the discussions. The unstructured dis- 
cussion procedure was the least effective; the presentation and demon- 
®t*^*tlon procedures were equally effective; the demonstration plus 
presentation procedure was most effective (.05 level of significance 
between pairs of treatment means). No differences were Indicated be- 
tween treatments on the written test scores. 

The results support the use of demonstrations condblned with pre- 
sentations In transiidttlng certain complex behaviors to teachers. 
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COMPARISON OF TRAINING PROCEDURES FOR PROMOTING 



TEACHER AND LEARNER TRANSLATION BEHAVIOR 

Gregg B. Mlllett ^ 

University of Texas ^ 

In the fall of 1965, the Stanford Center for Research and Develop- 
ment In Teaching accepted a proposal for the development of videotapes 
demonstrating selected teacher and pupil behaviors relevant to secondary 
school social studies. Several tapes from the audio-visual library of 
the Stanford Secondary Teacher Education Program were selected for pos- 
sible use In the Social Studies Oirrlculum and Instruction Course. Two 
of these tapes, entitled "Initiating Student Oral Reports," and "Discuss- 
ing a CoDq>lex Contemporary Problem," were shown In the course on an ex- 
ploratory basis. Positive feedback. In the form of a rating guide, open- 
ended written evaluations, and face-to-face Informal comments was obtained 
from the social studies Interns. 

An extensive review of film catalogues, as well as Inquiries to pub- 
lishers and universities, revealed a number of films that were relevant 
to secondary school social studies. The films dealt with discussion 
methods, general teaching methods, problem-solving methods, small group 
Instruction, role-playing, discipline, and the operation and uses of sever- 
al audio-visual devices. Dr. Edwin Fenton, at Carnegie Institute of 
Technology, had just developed five half-hour films portraying a teacher 

^The research described here was carried out while the author was a 
Research Assistant at the Stanford Center for Research and Development 
In Teaching. 
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and his pupils exploring five questions during the first five days of a 
world history class. The questions raised were: How does the historian 

classify information, prove a hypothesis, decide what is fact, ask ques- 
tions, and deal with "mind set"? 

Although no relevant videotapes were found ready for distribution, 
a few projects were under way. Indiana University was producing video- 
tapes designed to display desired teacher and pupil behavior in secondary 
school classrooms. The University of Colorado was developing videotapes 
designed to show certain "good" and "bad" practices in secondary school 
social studies. In addition, several teacher training Institutions were 
beginning to use videotaping equipment and were simultaneously develop- 
ing unplanned collections of videotapes. 

From the viewpoint of the present study, the problem with most of 
the existing films and videotapes was their failure to focus upon desired 
cognitive objectives, displayed in terms of pupil behavior. Only in the 
Fenton films was the general focus upon a type of pupil behavior denoted 
as "inquiry." All of the other films and videotapes seemed Inadequate 
for use In the kind of training which emphasizes the systematic develop- 
ment of specified cognitive behaviors In the pupil. 

Statement of the Problem and Overview of the Study 

TWO broad questions evolved from these initial explorations by the 
Stanford Secondary School Social Studies Videotaping Project: (a) Could 

videotapes be produced which displayed both selected pupil cognitive be- 
havior desired in secondary school social studies and also developmental ly 
related teacher behavior? (b) If produced and used for training purposes, 
could the videotapes be demonstrated to influence the teaching behavior 



of intern teachers? 
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In presenting partial answers to these two major questions, this 
study has attempted to resolve three related difficulties: conceptual, 

developmental, and experimental problems. 

Conceptual Problem 

The conceptual problem was to Identify the different types of teach- 
er and pupil behavior so that classroom behavior could be quantified. 

This was necessary In order to select special teacher and pupil actions 
fo^ display on videotapes, as well as to determine the effects of the 
videotapes on the Intern teachers' classroom behavior. 

Two types of pupil behavior were Identified and denoted as pupil 
oral translation , and pupil written translation . These translation be- 
haviors were defined as statements by pupils about the meanings of writ- 
ten words, and combinations of written words, In light of the context In 
which the words were used. Pupil oral translation consisted of state- 
ments made In classroom discussion; pupil written translation consisted 
of written answers on a test designed for the study. An example of pu- 
pil translation behavior would be: "It seems to me that by 'nightmare 

world,' Mr. Wechsler Is trying to say that the committee Is twisting 
things around." 

Seven types of behavior by the teacher, denoted as teacher transla- 
tion tactics , were Identified and assumed to be useful In achieving pu- 
pil oral translation. These behaviors were (a) translation directions, 
(b) translation elicitations, (c) translation acceptances, (d) transla- 
tion rejections, (e) translation probes, (f) translation restatements, 
and (g) translation silences. Combinations of these translation tactics 
were denoted as translation strategies . 



Developmental Problem 



The developmental problem of this study was to create the materials 
required by an experimental analysis. These materials Included the video- 
tapes which displayed the pupil oral translation and the teacher transla- 
tion tactics; the guide used by raters to score the teacher and pupil be- 
haviors; the standardized experimental lessons for classroom use; and a 
written test of the ability to translate. 

Experimental Problem 

The experimental problem of this study was to test the effect of dem- 
onstration videotapes, which displayed the teacher translation tactics used 
by teachers to achieve pupil oral translation, on the ability of intern 
teachers to use the translation tactics to achieve pupil oral and written 
trans lation. 

Forty-three intern teachers were randomly assigned to four different 
training groups. All of the interns received the same classroom material 
for use in their experimental lessons, which were to be conducted on one 
of the two days following their training. One training group participated 
in an unstructured discussion of the material they were to teach; a second 
group was orally instructed In the use of teacher translation tactics; a 
third group viewed two videotapes demonstrating the use of the teacher 
translation tactics; the fourth group received oral instruction in the 
use of teacher translation tactics and also viewed the two demonstration 
videotapes . 

During one of the two days following their training, the Interns 
taught an experimental lesson In one of the secondary school social stud- 
ies classes which they normally taught. These experimental lessons were 
recorded on audiotape, and toward the end of the lessons the tests of writ- 
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ten translatioii ability were admiiilstered. The clasaroon recordings pro- 
vided the date for measuring pupil oral translation the teacher trans- 
lation tactics, while the written tests provided a measure of pupil writ- 
ten translation ability* 

Hypotheses Tested 

It was hypothesized that the four training procedures would influence 
translation behaviors, i.e., pupil oral translation, pupil written trans- 
lation, and the teacher translation tactics, in the following ways: 

1. The oral instruction procedure would produce significantly 
more translation behavior than would the unstructured dis- 
cussion procedure* 

2* The demonstration procedure would produce significantly 
more translation behavior than would the oral instruction 
procedure* 

3* A coaiiination of the oral instruction and demonstration pro- 
cedures would produce significantly more translation beha- 
vior than would either procedure alone* 

Procedures 

The procedures of this study were grouped into three stages — a con- 
ceptual stage, a developmental stage, and an experimental stage — idiich 
represented the three major problems under investigation* 

Conceptual Stage 

Upon first consideration, classroom discourse appears to fall into 
two simple categories: teacher talk, and pupil talk* However, further 

reflection on oral behavior in the classroom can lead to maiqr schemes for 
analyzing and classifying such behavior* The purpose of this study was to 
identify a relatively simple class of pupil bdhavior irtiich represented de- 
sirable educational outcomes in secondary school social studies and to 
identify a few types of teacher behavior which were relevant to attain- 
ing the desired pupil behavior* Identifying an educationally desirable 
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class of pupil behaviors led to an investigation of different types of 
cognitive b^avior evident in teacher-pupil verbal interaction. Identi- 
fying relevant teacher behavior led to an investigation of the different 
verbal .*»tlons used by teachers in directing pupils toward intended goals. 

Cognit ive behavior . The classifications of cognitive behavior made 
in this study are related to the systems of Bloom, et al. (1956) and 
Bellack, et al. (1963). The class of cognitive behavior of primary con- 
cern was derived largely from the Bloom system and was denoted as trans- 
lation. 

Translation is defined as amanlng, 

...that an individual can put a comminl cation into other 
l an g uage , into other terms, or into another form of comsu- 
nication. It will usually involve the giving of 
to the various parts of a cnsaainlcation, taken in isolation, 
although such amanlngs masf in part be determined by the con- 
text in which the ideas appear (Bloom, et ^., 1956, p. 89). 

During the early phases of the study, it appeared that this defini- 
tion of translation would be adequate. It provided the basis for the de- 
velt^iment of the written translation test as well as the ilrmniml i it Ion 
videotapes. However, the training of raters to analyse iwid classify the 
audiotapes of classroom discourse revealed that "translation” needed to 
be delineated more precisely. Translation, therefore, was limited to re- 
fer only to statesmnts about the meanings of written words, ««d combina- 
tions of written words, as they are used in a particular context. Thus, 
translation behavior is empirical behavior, in that it consists of state- 
ments about the meanings of words used in a communication, the verifica- 
tion of which dep«ds upon internal evidence drawn from the context. 

P>H>il oral translation. Within the context of classroom discourse, 
where the teacher is trying to teach pupils to translate parts of sosm 
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written material, the translation behaviors are the pupil's responses to 
certain behavior hy the teacher* These responses are denoted as pupil 
oral translation behaviors. 

Pupil oral translation behaviors were categorised as being of two 
types: 

1. Initial Oral Translation Responses: These represent the 

first translation responses given hy the student to the 
various parts of a cosmnication; e.g., "It seems to me 
that hy 'nightmare world* Mr. Wechsler is trying to say 
that the committee is twisting things around." 

2. Secondary Oral Translation Responses: These represent 

translation responses idiich follow the first translation 
response to a given part of a communication. Secondary 
oral translation responses often were eiqpansions or im- 
provements upon an initial oral translation response; e.g., 

"By that he means that the things he siQrs ere being twist- 
ed around hy McCarthy and used against him." 

Teacher translation tactics and strategics. The following types of 
teacher behavior were assumed to he related to the development of pupil 
oral translation. Each of these teacher translation tactics was assumed 
to serve different developmental functions. 

1. Translation Directions: These include teacher statements 

which direct pupils to the task of oral translation; e.g., 
"Let's see if we can figure out the mea nin gs of some of 
the things being said in this article." 

2. Translation Elicitations: These include teacher questions 

intended to evoke initial oral translation responses from 
pupils; e.g., *Vhat does Mr. Wechsler mean, here on page 
seven, when he s^s it's a ^nightsiare world*?" 

3. Translation Acceptances: These include teacher statements 

such as, "Good," or, "That's right," which indicate that 
the teacher is either partially or totally accepting a pu- 
pil oral translation response. 

4. Translation Rejections: These include teacher statements 

such as, "Mo," or, "I don't think so," which indicate that 
the teacher is either partially or totally rejecting a pupil 
oral translation response. Translation acceptances and re- 
jections nay he used together in discriminating smong the 
parts of a pupil response. 
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5# Translation Probes: These include teacher <{uestions in- 

tended to evoke iaiproved or expanded oral translation 
responses from either an initially responding pupil or 
from another pupil* These probing questions will often 
ask the pupil to clarify what he or to attempt to 

be more complete in his translation; e.g., "Can yoii ex- 
plain that further?" 

6* Translation Hints: These include teacher stateaients which 

give partial translation or directions intended to assist 
a pupil in achieving an oral translation response; e*g*, 

"lti.^t he be referring to Senator McCarthy's tactics here?" 

7* Translation RestateaKnts : These include teacher restate- 

awnts of the oral translation responses of pupils, or a 
summarization of several pupil oral translation responses* 

These statements may consist of some clarifications; how- 
ever, statements which represent translations by the teach- 
er are not considered restateaients* 

8* Translation Silences: Althou^ not an oral b^avior, this 

category is included because it is related to the devel<q>- 
ment of translation* It is an interval idiich lacks oral 
behavior and idiich is intended to give pupils time to ex- 
plore the sMterial or to think about the question in order 
that they may make an oral translation rosponse* 

Coidbinations of these teacher translation tactics, employed for the 
purpose of achie^dng pupil oral translation behavior, were denoted as 
translation strategies* 

The ei|^t teach«r translation tactics and the use of these tactics 
as strategies for tea chin g piq>il oral translation were presented to in- 
tern teachers in three types of training procedwres* However, during the 
training of raters for analysis of the audiotapes, it was discovered that 
translation hints were difficult to distinguish from translation probes* 
Translation hints, therefore, were reclassified as a sidicategory of trans- 
lation probes* 

Developmental Stage 

A written communication was developed to serve as a basis for the 
classroom discussions, and a written test was designed to measure the pu- 
pils' ability to translate parts of the written comnication* Two dem- 
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onstratlon videotape! were a8seiid>led, each diip laying the teacher trans- 
lation tactics and pupil oril translation. Finally, an Interaction-analy- 
sis guide was developed for scoring and classifying classroom verbal beha- 
vior. 

The written cosminlcatlon . The demonstration videotapes and the dis- 
cussions conducted by the Intern teachers were all based upon the written 
material entitled, "A Senate Subcommittee Investigation: The Testimony of 

James A. Wechsler." This coomunlcatlon was synthesized from sixty- four pa- 
ges of subcommittee hearings concerning the examination of James A. Wechsler 
by Senator Joseph McCarthy (see U. S. Senate, 1953). 

The material was pretested In one school by three teachers and 150 
pupils representing a wide range of ability and three grade levels — tenth, 
eleventh, and twelfth. The material was judged to be extremely Interest- 
ing by the teachers and by most of the pupils. Although It was judged easy 
to read by most of the pupils, there was wide disagreement on this point. 
Some parts, e.g., the selection from the Dally Worker, were commonly agreed 
upon as being more difficult to understand than others. It was agreed upon 
by all teachers that the communication tended to raise questions not In- 
cluded In translation objectives, e.g.. Who was right and who was wrong? 

Was Wechsler really a Communist? Is this kind of Interrogation democratic? 
The results of the pretest Indicated that the material would be appropriate 
for use In the study. 

The written translation test . The written test was designed to measure 
the pupils' ability to translate: It required short answers to questions 

about the meanings of words and combinations of words contained in the writ- 
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The test was pretested on 60 tenth> eleventh, and twelfth-grade pu- 
pils* Those Items which were confusing, or which discriminated In a re- 
verse order, were eliminated. A revised test, containing 12 questions, 
was then pretested on 80 twelfth-grade pupils* The Items ranged In dif- 
ficulty from 19 to 93 percent missed* The mean number of errors was 5*76, 
with a standard deviation of 2*61* In scoring these pretests, two raters 
were In agreement on 91*5 percent of the Items as to whether the answers 
were correct or Incorrect* The test's reliability was computed to be *71 
by the split-half method (Downle, 1958)* 

After scoring the pretests, a "translation-test scoring guide" was 
written for use In scoring the written tests to be administered to pupils 
following the experimental discussions* 

Videotaped demonstrations * Two videotapes, dlsplajrlng the teacher 
translation tactics and pupil oral translation responses, were developed 
for use In two of the experimental training treatments of the study* 

IVo public school teachers served as demonstration teachers after each 
had become thoroughly acquainted with the written communication and the 
general frame of reference of the study* They then used the translation 
tactics to achieve pupil oral translation In two of their regular twelfth- 
grade classes* Those four lessons were videotaped and from them two por- 
tions, one eight minutes long and one six minutes long, were selected to 
serve as demonstration tapes for the e3q>erlmental study* The portions 
selected had at least one example of each teacher's translation tactics 
and several exaiiq[>les of Initial and secondary pupil oral translation res- 
ponses* 

The Interaction-analysis guide * In order that classroom discussion 
could be categorised, an Interaction-analysis guide was designed as a 
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general classification system applicable to classroom discussion in sec- 
ondary school social studies* The guide specifically accounted for the 
behavior of priaiary interest in the study, i#e#, the seven teacher trans- 
lation tactics, and the two types of pupil oral translation: it required 

the raters to determine the "speaker," the "pedagogical move," and the 
*'class of cognitive behaviors" which were represented in classroom oral 
behavior. 

The "speaker" was either the teacher or a pupil, or, in some situa- 
tions, might refer to an audio device or a person not normally in the 
classroom. 

"Pedagogical moves" referred to the function of oral behavior. The 
functions identified in the guide were (a) task directions, (b) elicita- 
tion, (c) probe, (d) silence, (e) initial response, (f) secondary re- 
sponse, (g) acceptance, (h) rejection, (i) restatement, (j) statement, 
and (k) procedural. To exhaust all classifications of classroom oral 
behavior along this dimension, three additional categories, which do not 
represent clear pedagogical functions, were included: (m) inaudible, 

(n) confusion, (o) not clear. 

The following six classes of cognitive behavior were defined in the 
guide: (a) translating, (b) defining, (c) fact stating, (d) internal 

explaining, (e) external explaining, (f) evaluating. To make exhaustive 
the classification of classroom cognitive behavior, four additional cate- 
gories were included: (g) incorrect, (h) in doubt, (i) not clear, and 

(j) no cognitive class evident. \ 

I 

The cognitive dimension of classroom verbal behavior included both 
overt and covert elements. For exaiiq>le, when a teacher asks, 'Vhat are 
the names of the people in this hearing you just read about?", it can be 
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inferred that the teacher is requesting fact-stating behavior: the cogni- 

tive dimension of the teacher's question is considered to be fact stating. 

The interaction analysis guide provided detailed descriptions of the 
dimensions of classroom oral behavior, with examples drawn from the writ- 
ten conmunication used in the study. The guide also presented coding rules 
designed to increase the reliability of making several difficult distinc- 
tions. Finally, the guide explained the general procedure for scoring the 
audiotapes. 

Experimental Sta^ e 

Sjjh^ect^. Of the original population of 46 social studies intern 
teachers enrolled in the Stanford Secondary Teacher Education Program, 
seven were unable for various technical reasons to complete satisfactorily 
all requirements of the present study. Thus, audiotaped data were gathered 
from 39 interns, while complete written test data were gathered from only 
34. Treatment group one contained 11 interns; treatment group two, ten 
interns (seven with complete data); treatment group three, 10 interns (nine 
with complete data); and treatment group four, eight interns (seven with 
conq>lete data). Data from the 39 interns were used to compare groups. De- 
scriptions of the relationships between the written test scores and other 
classroom behaviors were based on the complete written and audiotape data 
obtained from the 34 interns' clas<trooms. 

Experimental design . Four experimental treatments were applied to 
four independent groups using a posttest-only design (Canq>bell & Stanley, 
1963). 

A pretest was not used in this study because it seemed highly prob- 
able that a pretest closely related to the specific content of the study 
would have produced main effects upon the criterion measures as well as 
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Interactions with the experimental treatments. More extensive designs 
to evaluate these effects were not feasible. Campbell and Stanley (1963, 
p. 196) suggest, however, that when no pretest Is used, ". . . If appro- 
priate antecedent variates are available, they should certainly be used 
for blocking or leveling, or as covarlates." Since the relatively small 
number of subjects In the experiment prohibited blocking and leveling pro- 
cedures, Information was collected on four antecedent variables and two 
concomitant variables for possible use as covarlates. These variables 
Included grade level, class ability. Interns' teaching ability, class size, 
time allotted for experimental discussions, and time allowed for taking 
the written tests. None of the antecedent or conc(»nltant variables were 
significantly correlated with pupil written translation or teacher trans- 
lation tactics. Means and standard deviations for the three variables — 
grade level, pupil ability, time allowed for written test — which were 
significantly correlated with pupil written translation are given In 
Table 1. These variables were used In supplemental covariance analyses, 
but these analyses provided no additional Information and will not be re- 
ported here. 



TABLE 1 
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Bceerlmental treatmentg . The author and two Stanford social studies 
supervisors served as instructors for the experimental treatments. The 
experimenter gave the oral presentations of treatments #2 and #4. The 
videotaped demonstrations of treatments #3 and #4 were introduced and cued 

by a second instructor. The discussion of treatment #1 was conducted by 
a third Instructor. 

Treatment one was an unstructured 30-mlnute discussion of the writ- 
ten communication carried on by the Instructor and the Interns. No fur- 
ther Instructions were given: neither pupil translation behaviors nor 

teacher translation tactics were mentioned. The discussion centered 
upon an explanation of certain parts of the material, of events related 
to the McCarthy hearings, and principally, upon an evaluation of Issues 
related to the hearings* 

Treatment two was a 16-mlnute oral description In which translation 
was presented as the desired pupil behavior. Systematic use of the eight 
teacher translation tactics was suggested as an appropriate way to achieve 
pupil oral translation responses. Examples of each of the tactics, based 
upon the written communication, were given. 

Treatment three consisted of two videotaped demonstrations of teacher 
translation tactics and pupil oral translation responses. 

The Instructor Introduced the tapes by explaining that the Interns 
should attempt to conduct a discussion like those presented on the vid- 
eotapes, with particular regard to achieving the same type of pupil re- 
sponse. 

Treatment four was a combination of the oral description and two vid- 
eotaped demonstrations which were presented singularly as treatments two 
and three. 




16 



Rating the classroom discussions « Two people were trained to rate 
audiotapes of classroom discussion. Practice rating was continued until 
at least 90 percent Interrater agreement was achieved on all of the trans- 
lation categories contaln*3d In the guide. Following their training, the 
raters began scoring the 39 audiotapes of classroom discussions* The 
tapes were randomly assigned so that both raters had the same number of 
tapes frcmi each treatmmit group (except for the 11 tapes In treatment 
one). Coefficients of rater agreement were obtained by having both ra- 
ters score the same eight tapes prior to randomisation of the remaining 
31. Also, Scott's reliability coefficients were ccxnputed across selected 
categories. This coefficient Is used by Flanders (1960) and Schroeder 
(1964). Flanders (1960, p. 10) describes Scott's coefficient "as the 
amount that two observers exceeded chance agreement divided by the amount 
that perfect agreement exceeds chance." These coefficients of rater 
agreement on pedagogical moves, cognitive classes, and translation be- 
haviors are presented In Tables 2, 3, and 4. 

TABLE 2 

Rater Agreement: Pedagogical Moves 





number of 

Pedagogical Moves Agreements 


Mhmber of 
Disagreements 


Coefficient of 
Rater Agreement 



Directions 


6 


2 


.75 


Elicitations 


115 


63 


.65 


Probes 


138 


89 


.61 


Silences 


20 


6 


.77 


Acceptwces 


194 


41 


.83 


Rejections 


3 


4 


.43 


Restatements 


158 


33 


.79 


Statements 


3 


17 


.15 


Responses 


348 


44 


.89 


Procedural 


10 


9 


.53 


All moves 


995 


237 


.81 



Scott's reliability coefflclei*w computed across 
the pedagogical move categories Is .82. 
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TABLE 3 

Rater Agreement: Cognitive Cleeses 





Process Categories 


Humber of 
Agreesients 


Ihxiber 

Disagreements 


Coefficient of 
later Agreement 



Defining 


0 


0 


... 


Translating 


118 


26 


.82 


Translating: Incorrect 


0 


0 


— - 


Translating: In doubt 


1 


0 


1.00 


Fact Stating 


51 


40 


.56 


Explaining: Internal 


598 


85 


.88 


Explaining: external 


53 


24 


.69 


Evaluating 


31 


44 


.41 


Hot Clear 


2 


7 


.22 


All moves 


854 


113 


.88 



Scott's rellebillty coefficient cosputed across 
the process categories Is 



Scoring the written translation tests ♦ A scoring guide, developed 
during the analysis of the pretests, was used to score the 34 sets of writ- 
ten translation tests administered In the study. These 34 classroom sets 
(858 Individual tests) were randomized by permutations of four (one from 
each aq»erimental treatment) Into two groups, one group being assigned to 
each rater, who scored Independently and without knowledge of experimental 
treatments. 

To establish a measure of Interrater agreement, five tests were ran- 
domly selected from each classroom set of tests, and these 170 tests (20 
percent of the total) were scored by both raters. In scoring the 2,040 
responses on these tests the raters were In agrecamnt 95.4 percent of 
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the time* For the entire test, reliability estimate of .82 was obtained 
by the split-half method (Downie, 1958)* This estimate was made from the 
20-percent sample of the tests scored by both raters. 



TABLE 4 

Rater Agreesient: Translation Behaviors 



Translation Categories 


IHiaiber of 
Agreements 


NuBiber of 
Disagreements 


Coefficient of 
Rater Agreesient 


Teacher translation 


directions* 


2 


1 


.67 


elicitations* 


17 


7 


.71 


probings* 


18 


15 


.55 


silences* 


5 


2 


.71 


acceptances* 


23 


12 


.66 


rejections* 


0 


0 




restatements* 


13 


5 


.72 


Teacher translation 


tactics: total 


82 


34 


.71 


Teacher translation 


statements 


1 


1 


.50 


Pupil translation: 
incorrect 


0 


0 




in doubt 


1 


1 


.50 


Pupil oral translation* 


40 


11 


.78 



^Scott's reliability coefficient cosqputed across 
these categories is .93. 



Results 



It was hypothesized that the four training procedures would differen- 
tially and predictably influence the frequencies of pupil oral transla- 
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tloa, teacher translation tactics, and pupil written translation. The 
means and standard deviations of these dependent variables for each of 
the experimental treatments are reported In Table 5. 

An analysis of variance for each of the three dependent variables 
(Table VI) Indicated that the differences between treatments on pupil 
oral translation and teacher translation tactics were statistically sig- 
nificant at the .01 level. The differences between means on the pupil 
written translation test was not significantly different from chance 
variation. Thus, the major experimental hjrpothesls was partially sup- 
ported by the results on two of the three dependent variables. It had 
also been hypothesized that the four training procedures would vary In 
the following ways: 

1. The oral Instruction would produce significantly more 
translation behavior than would the unstructured dis- 
cussion. 

2. The demonstration would produce significantly more 
translation behavior than would the oral Instruction. 

3. A combination of oral Instruction and demonstration 
would produce significantly more translation behavior 
than would either alone. 

To test these l^otheses, conq>arlsons were made between all pairs 
of treatments for the mean frequencies of pupil oral translation and 
teacher translation tactics by means of the Newman-Keuls test (Winer, 
1962). These coiq>arlsons revealed that the effects of treatment four 
were significantly different (p K. *05) from the other three treatment 
groups on both pupil oral translation and teacher translation tactics. 
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TABLE VI 

Analysis of Variance of the Three Dependent Variables 



Dependent Variables Source of 

Variation 


Sum of 
Squares 


Degrees of 
Freedom 


Mean 

Square 


Pupil Oral 


Treatments 


526.83 


3 


175.61 


Translation 


Within Groups 


864.76 


35 


24.71 




Total 


1391.59 


38 




Teacher Trans- 


Treatments 


3019.79 


3 


1006.60 


lation Tactics 


Within Groups 


4871.28 


35 


139.18 




Total 


7891.08 


38 




Pupil Written 


Treatments 


9.96 


3 


3.32 


Translation 


Within Groups 


120.68 


30 


4.03 




Total 


130.64 


33 





F 

Ratio 



7.11 



7.23 



.01 



.01 



NS 



However, there were no significant differences between any other 
pair of treatments, nor were there any significant treatment differen- 
ces on the written translation test scores. 

Because It seemed unlikely that the assumptions of normality of 
distribution and hooiogenelty of variance had been met, the data were 
analyzed further using the nonparametrlc Kruskal-Wallls test. This 
procedure revealed that treatment one produced significantly fewer 
(p ^ .05) pupil translation behaviors and teacher translation tactics 
than did treatments two, three, or four. No other significant differen- 
ces were found. 



Discussion 

The statistical analyses of the results of the four training pro- 
cedures Indicated that the unstructured discussion procedure (treatment 
one) was significantly Inferior to the other three training procedures. 

The more stringent parametric tests Indicated that the differences between 
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treatment four and treatments two and three were significant at the .05 
level; however, these results might be questioned due to assumption vio- 
lations for the parametric test. Nevertheless, the observed differences 
between treatment four and treatments two and three may have practical 
utility. 

The data did not show differences between treatments on the measure 
of pupil written translation — although there was a -0.30 correlation 
(nonsignificant) between pupil written translation and teacher transla- 
tion tactics. (The correlations were negative because the test scores 
were e3q>ressed in errors.) The absence of treatment differences was sur- 
prising, since little time was devoted to translation by the unstructured 
discussion group (treatment one), whereas 20 percent of the teacher-pu- 
pil behaviors In the oral Instruction plus demonstration group (treatment 
four) consisted of translation. 

The findings question the efficiency of translation-oriented dis- 
cussions as a means of developing pupil written translation; they sug- 
gest that teacher translation tactics may not fulfill the function of 
developing pupil oral translation as much as they serve to assess pu- 
pils' abilities to translate material that has been read. 

Another possibility Is that discussions which are oriented toward 
cognitive behavior other than translation may demand var 3 ring degrees of 
unspoken translation. For example. If a teacher asks, "Is McCarthy be- 
ing fair in making this accusation?", the pupil may find It necessary to 
translate the accusation before making a judgment of fairness. 

The results, while Indicating that there were no treatment differen- 
ces with respect to pupil written translation, raise, hut do not answer, 
a complex question: To what extent does the ability to translate result 



23 






from reading,^ or from different types of discussions? 

Several aspects of the results and training procedures regarding 
the treatment differences on pupil oral translation and teacher trans- 
latloTi tactics need further exploration. Translation was chosen as a 
behavior whose frequency, without the explicit direction of teachers or 
pupils, could be expected to be low In classroom discussions. Ifowever, 

It was not considered to be a contrived or Irrelevant task. The occur- 
rence (twice) of translation behavior In the unstructured discussion 
group Indicated that translation does occur without translation-orien- 
ted training. However, the data do not truly provide a baseline Indi- 
cation of the frequency of translation behavior In the "average" social 
studies classroom or under different conditions. It appears that both 
the material used for the discussions of this study and the unstructured 
discussion treatment, by encouraging evaluative-type behaviors, tended 
to discourage translation behavior. 

There Is a major problem regarding the three translation-oriented 
training procedures: the most effective procedure resulted In discus- 

sions composed, on the average, of only 20 percent translation behaviors, 
and the other two procedures produced only about 12 percent. The Inef- 
ficiency of the training procedures can be attributed primarily to a lack 
of clarity concerning the concept of translation. The main characteris- 
tic of translation that appeared to result from the oral instruction was 
that a pupil had put a communication into his own words. The more pre- 
cise definition of translation, particularly the characteristic, "in 
light of the context," was made during the training of raters — after 

^Several studies suggest that simple translation instructions 
given prior to the reading of material would result in gains 
in pupil written translation (Rothkopf, 1965, pp. 208-215; 

Lumsdaine, 1963, pp. 640-643; Fischer, 1958). 



the experiment had been conducted. 

The three experimental treatments of this study used relatively 
weak training procedures. It appears that if a clearer definition of 
translation had been used in the training procedures, ^nd if it had 
been supported by numerous examples related to the material to be used 
in the classroom, then the efficiency of the training procedures would 
have been greatly inq>roved. 

The oral instruction plus demonstration procedure was about twice 
as long as either of the other translation training procedures. How- 
ever, if the Instruction time for this procedure had been the same as 
for the other two procedures, both the oral instruction and the demon- 
stration components of the procedure would have had to have been altered. 
Thus, training duration and training procedures are confounded for treat- 
ment four. 

Conclusions and Implications 

The results of the eiq>erlment, although not conclusive, suggested 
that the behavior of intern teachers, relative to the attainment of a 
specified class of pupil behavior, could be affected by relatively 
short presentation- type training procedures. The evidence indicated 
that either oral instruction or demonstration presentations alone could 
change the behavior of intern teachers, but that a combination of the 
two procedures may have resulted In more of the Intended behavior than 
either procedure alone. It Is iiiq>ortant to note that these behavior 
changes can be brought about without employing overt practice or feed- 
back as part of the training. 

Several factors limit the generallzablllty of these findings, and 
at the same time suggest possibilities for futu, e research. The rela- 
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tlvely low proportions of translation behavior In the three groups re- 
ceiving translation training suggest that these procedures were far from 
optimal. Further research must determine the combination of factors 
which lead to optimum efficiency of oral (and written) Instruction, dem- 
onstration, and oral Instruction plus demonstration procedures. The 
definition of translation and the unconfounding of the Instruction- time 
variable are two crucial factors which await additional Investigation, 
The effects of different training procedures on the achievement of 
pupil cognitive behavior other than translation and In the transmission 
of specified teacher skills and strategies are also areas of potentially 
fruitful explorations. The absence of observed treatment differences on 
pupil written translation, contrasted with the significant correlation 
between pupil oral translation and pupil written translation, suggests 
the need for further research In this area. 
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